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Method for Increasing Peripheral Component Interconnect (PCI) Bus 
Throughput Via a Bridge for Memory Read Transfers via Dynamic 

Variable Prefetch 

Background 

Technical Field of the Invention 

The present invention relates to improving memory read performance 
of a PCI bus, and more particularly to methods of processing prefetchable 
Memory Read Multiple cycles via a bridge. 

Problem Statement 

A Peripheral Component Interconnect (PCI) bus supports three main 
types of bus cycles: Configuration, Input/Output (1/0), and Memory. 
Configuration and 1/0 cycles make up a very small percentage of PCI bus 
cycles. However, memory cycles constitute the vast majority of PCI bus 
cycles on a typical PCI bus. 

Memory cycles can be broken up into 2 types: read cycles (reads), 
and write cycles (writes). Read cycles typically dominate bus traffic, and 
include memory read, memory read line, and memory read multiple 
commands. Typical applications have a greater percentage of read traffic in 
comparison to write traffic. However, read transfers suffer from the fact that 
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they are inherently less efficient than write transfers. Accordingly, methods 
are needed for increasing PCI bus throughput for memory read transfers. 

High performance devices tend to use the memory read multiple 
commands when requiring a large amount of data to achieve higher memory 
read performance. These commands are supported by most processor 
chipsets today resulting in the fetching of multiple cache lines of data when 
they are the target of such commands. However, when a PCI bridge is used 
to create a first bus and a second bus they tend to threat all memory read 
commands the same resulting in the pre-fetching of the same data. 
Conventional PCI bridge chips thus cause data transfers to take place as 
smaller less efficient bursts, creating a serious system performance impact. 

There is a desire to provide an enhanced solution for increasing data 
transfers over a PCI-PCI bridge for facilitating improved transfer of data 
between high performance devices. 
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Summary of the Invention 

The invention provides technical advantages as an innovative method 
and system for enhancing memory read performance of a PCI bus over a 
bridge by extending the size of the read prefetch for Memory Read Multiple 
cycles. One embodiment provides a first bus adapted to facilitate data 
transfer, a second bus adapted to facilitate data transfer, and a bridge that 
couples the first bus to the second bus. The bridge is adapted to perform 
memory read, memory read line, and memory read multiple commands (from 
the first bus to a target on the second bus). Advantageously, the bridge 
responds to the memory read multiple command differently than either the 
memory read or the memory read line command to achieve increased data 
transfer across the bridge, especially between high performance devices. 

In an alternative embodiment, the invention is a controller adapted to 
facilitate data transfer between a first bus and a second bus. The controller in 
the alternative embodiment is adapted to prefetch more data from the target 
in response to the memory read multiple command than other memory read 
commands. 

This invention offers an optimal solution for PCI to PCI bridge designs 
that matches the type of memory read operation (and the performance need 
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that it implies) with the most appropriate read prefetch size. Memory read 
and memory read line operations typically imply that smaller amounts of data 
are being requested, and are used by most PCI based chips. Therefore, 
these operations should correspond to the smallest memory read prefetch 
sizes. Memory read multiple operations typically imply that very large 
amounts of data are being requested, and are used by the highest 
performance PCI based chips. Thus, these operations should correspond to 
the largest memory read prefetch sizes. 

Of course, other features and embodiments of the invention will be 
apparent to those of ordinary skill in the art. After reading the specification, 
and the detailed description of the exemplary embodiment, these persons will 
recognize that similar results can be achieved in not dissimilar ways. 
Accordingly, the detailed description is provided as an example of the best 
mode of the invention, and it should be understood that the invention is not 
limited by the detailed description. Accordingly, the invention should be read 
as being limited only by the claims. 
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Brief Description of the Drawings 

Various aspects of the invention, as well as an embodiment, are better 
understood by reference to the following EXEMPLARY EMBODIMENT OF A 
BEST MODE . To better understand the invention, the EXEMPLARY 
EMBODIMENT OF A BEST MODE should be read in conjunction with the 
drawings in which: 

Figure 1 is a block diagram illustrating prefetching data from a 
target over a PCI-PCI bridge; 

Figure 2 is a block-flow diagram of a conventional PCI to PCI 
bridge handling a memory read multiple command; and 

Figure 3 is a block diagram of a PCI-to-PCI bridge handling 
memory read multiple commands. 
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Detailed Description of a Preferred Embodiment 

When reading this section (An Exemplary Embodiment of a Best 
Mode, which describes an exemplary embodiment of the best mode of the 
invention, hereinafter "exemplary embodiment"), one should keep in mind 
5 several points. First, the following exemplary embodiment is what the 
inventor believes to be the best mode for practicing the invention at the time 
this patent was filed. Thus, since one of ordinary skill in the art may 
recognize from the following exemplary embodiment that substantially 
U equivalent structures or substantially equivalent acts may be used to achieve 

3 10 the same results in exactly the same way, or to achieve the same results in a 
O similar way, the following exemplary embodiment should not be interpreted 

as limiting the invention to one embodiment. 

£ Likewise, individual aspects (sometimes called species) of the 

15 invention are provided as examples, and, accordingly, one of ordinary skill in 
the art may recognize from a following exemplary structure (or a following 
exemplary act) that a substantially equivalent structure or substantially 
equivalent act may be used to either achieve the same results in substantially 
the same way, or to achieve the same results in a similar way. 

20 
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Accordingly, the discussion of a species (or a specific item) invokes 
the genus (the class of items) to which that species belongs as well as 
related species in that genus. Likewise, the recitation of a genus invokes the 
species known in the art. Furthermore, it is recognized that as technology 
5 develops, a number of additional alternatives to achieve an aspect of the 
invention may arise. Such advances are hereby incorporated within their 
respective genus, and should be recognized as being functionally equivalent 
or structurally equivalent to the aspect shown or described. 

10 Second, only essential aspects of the invention are identified by the 

claims. Thus, aspects of the invention, including elements, acts, functions, 
and relationships (shown or described) should not be interpreted as being 
essential unless they are explicitly described and identified as being 
essential. Third, a function or an act should be interpreted as incorporating 

15 all modes of doing that function or act, unless otherwise explicitly stated (for 
example, one recognizes that "tacking" may be done by nailing, stapling, 
gluing, hot gunning, riveting, etc., and so a use of the word tacking invokes 
stapling, gluing, etc., and all other modes of that word and similar words, 
such as "attaching"). Fourth, unless explicitly stated otherwise, conjunctive 

20 words (such as "or", "and", "including", or "comprising" for example) should 
be interpreted in the inclusive, not the exclusive, sense. Fifth, the words 
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"means" and "step" are provided to facilitate the reader's understanding of 
the invention and do not mean "means" or "step" as defined in §112, 
paragraph 6 of 35 U.S.C., unless used as "means for -functioning-" or "step 
for -functioning-" in the Claims section. 

There are 3 types of memory read cycles: memory read, memory read 
line, and memory read multiple. Memory read cycles are the basic memory 
read command. They support single data phase as well as burst operation, 
and support data prefetching. Memory read commands have no specific 
relationship with Cache memory or Cache lines. They have no implied size 
requirements, and although they are the basic memory read command, they 
are typically not used in high performance situations. 

Memory read line cycles are used typically when a device is accessing 
Cache memory (although they can be used by a device accessing non-cache 
memory as well). They support single data phase as well as burst operation 
and support data prefetching. Memory read line commands relate to cache 
memory and cache lines in that they are intended to access data in cache 
line sized chunks. For example, if the system cache line size is 16 DWords, 
then a memory read line command usually implies that the originating device 
intends to transfer a cache line worth of data (in this case 16 Dwords). 
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Memory read multiple cycles are used typically when a device is 
accessing Cache memory (although they can be used by a device accessing 
noncache memory as well). They support single data phase as well as burst 
5 operation, and support data prefetching. Memory read multiple commands 
relate to cache memory and cache lines in that they are intended to access 
data in cache line size chunks (similar to memory read line commands). 

However, the use of memory read multiple commands implies that the 
requestor wants to transfer multiple cache lines (not a single cache line like 
the memory read line command). Because of this, the memory read multiple 
command has an implied data prefetch of multiple cache lines. This offers 
much higher read performance for high end systems. Accordingly, systems 
which aim at high memory read performance tend to use memory read 
multiple commands. Typical systems are high speed disk arrays (for 
example, SCSI hard disk) and graphics chips. 

The invention provides optimal PCI to PCI bridge designs that match 
the type of memory read operation (and the performance need that it implies) 
20 with the most appropriate read prefetch size. Memory read and memory 
read line operations typically imply smaller amounts of data being transferred 
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and are used by most PCI based chips. Therefore, these operations 
correspond to the smallest memory read prefetch sizes. Memory read 
multiple operations typically imply very large amounts of data being 
transferred, and are used only by the highest performance PCI based chips. 
5 Therefore these operations correspond to the largest memory read prefetch 
sizes. 

Prefetching is a concept used with memory read commands to boost 
memory read performance. In one simple implementation, a device (target 

10 device), such as a PCI to PCI bridge, is the target of a memory read 
command (memory read, memory read line, or memory read multiple). The 
device reads (also called "fetches") a fixed amount of data (for example, 8 
DWords, or 16 DWords) even though the target device doesnt know at the 
start of the PCI bus cycle how much data is desired by the requesting device. 

1 5 What the target device (the PCI to PCI bridge in this exemplary case) hopes 
is that it fetches more data than the requesting device needs. The target 
device "preMetches data before it actually sees that the requesting device 
actually wants it. Thus, by the time the requesting device actually gets to the 
point of requesting the data, the data is hopefully already fetched by the 

20 target. Thus, prefetching is more optimal than fetching a data value only 
when the target device sees that the requesting device wants it. 
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Figure 1 shows a system and method of prefetching at 100. A PCI 
Master 110 desires to read an undetermined amount of data from a PCI 
Target 120. The PCI Master 1 10 in this case could be a USB device, a hard 
5 disk controller, or any PCI Master type device, for example. The PCI Master 
110 starts a PCI memory read cycle for an undetermined amount of data. A 
PCI to PCI bridge 150 passes a memory read command up to primary PCI 
bus but requests several DWords of data in anticipation that the PCI Master 
110 will want them as well. 

10 

The PCI Target 120 represents any PCI based memory resource 
sitting on a primary PCI bus 130. The PCI Master 1 10 starts off by initiating a 
PCI Memory read cycle that specifies the PCI Target address. The PCI to 
PCI bridge 1 50 typically accepts the PCI cycle but tells the PCI Master 1 1 0 to 
15 retry the cyclelt does this because the read command may take varying 
amounts of time to complete and it's more efficient to have the PCI Master 
1 10 release a secondary PCI bus 160 so that others may use it. 

The PCI to PCI bridge 1 50 then passes this transfer up to the primary 
20 PCI bus 130 to access the PCI Target 120 for the PCI Master 110. The 
problem is that the PCI bus protocol does not allow the PCI to PCI bridge 
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device to know how much data the PCI Master 1 10 had intended to transfer. 
In an attempt to be efficient, the PCI to PCI bridge 150 requests several 
DWords of data from the PCI Target 120. The size of the "prefetch" is 
chosen to be optimal. If the prefetch is too small, then the bridge won't fetch 
enough data and the PCI Master 110 will have to make another request for 
the rest of the data. If the "prefetch" is chosen too large then time is wasted 
fetching data that is not needed. 

The fact that the data is prefetched for the PCI Master 1 1 0 makes the 
overall transfer more efficient. For example, the initial memory read from the 
PCI Target 120 might have taken two microseconds to complete. The 
subsequent data cycles would probably complete very quickly afterwards as 
a part of the burst cycle (for example, once every thirty nanoseconds). 
Without the prefetch, the two microsecond access time would be incurred for 
each data phase, for a total access time of 64*2 microseconds = 128 
microseconds. 

How typical PCI to PCI bridge devices handle memory reads, 
prefetching 

High performance devices, such as PCI Based SCSI disk controllers 
and graphics chipsets, tend to use the memory read multiple commands to 
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achieve higher memory read performance. Most processor chipsets today 
support the use of the memory read multiple command and fetch multiple 
cache lines when they are the target of such commands. One problem with 
this is that conventional PCI to PCI bridge chips (bridge chips) treat the 
5 memory read multiple command like any other memory read command. 

Accordingly, conventional bridge chips prefetch the same amount of 
data with a memory read multiple command as they do with a memory read 
command. So bridge chips ignore the fact that a high performance device 

1 0 requesting data uses the memory read multiple command to attempt to read 
system data (typically from system RAM) in large chunks, and that the 
processor chipset fetches data in large chunks if correctly requested to do so. 
But, the intervening PCI to PCI bridges of today mess this up and cause the 
data transfers to take place as smaller less efficient bursts. This has a 

15 serious system performance impact. 

Figure 2 provides a diagram of a PCI to PCI bridge 250 handling a 
memory read multiple command according to conventional techniques. 
Conventionally, a SCSI disk controller (disk controller) 210, that is coupled to 
20 a PCI to PCI bridge 250 via a secondary PCI bus 21 5, attempts to read large 
amounts of data from system memory 220, such as random access memory 
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(RAM). The disk controller 210 uses the memory read multiple command in 
an attempt to read data from system RAM 220 in large bursts. A host bridge 
230 handles memory read multiple commands (typically generated by a CPU 
235) efficiently and will prefetch multiple cache lines when it receives a 

5 memory read multiple command. The initial delay (from the time the host 
bridge 230 receives the memory read multiple command until it starts 
pumping out read data) might be on the order of one or two microseconds. 
The subsequent data comes out quickly (each tick of the PCI clock). Thus, 
the host bridge 230 fetches multiple cache lines from system RAM 220 

10 whenever it receives a memory read multiple command. After a memory 
read multiple command has completed, it will flush its prefetch buffers 232. 

The PCI to PCI bridge (the bridge) 250, disadvantageous^, 
15 conventionally passes the memory read multiple command up to the host 
bridge 230 as a smaller cycle than it should for optimal performance. The 
host bridge 230 should pass the memory read multiple command up as 
multiple cache lines, but instead, the host bridge 230 passes the memory 
read multiple command up just like any other memory read command (which 
20 is typically smaller than a cache line). Therefore, the host bridge 230 
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disadvantageously waits until the host bridge 230 starts to see read data 
come in (a one to two microsecond delay). 

In other words, typical PCI to PCI bridges pass the memory read 
5 multiple command up to the host bridge, but treat it like any other memory 
read command. Hence, the prefetch size is usually not a multiple of cache 
lines, but is actually smaller than a cache line. This means the memory read 
operation will get broken up into lots of smaller memory reads (which is not 
very efficient and wastes processing time). 

10 

When the host bridge 230 stops the PCI cycle, the host bridge 230 
flushes its prefetch buffers 232. The PCI to PCI bridge 250 then passes the 
read data down to the SCSI disk controller 210. When the host bridge 230 
sees that the SCSI disk controller 210 actually wanted more data than the 
15 host bridge 230 had fetched, the host bridge 230 issues another memory 
read multiple command on the a primary PCI bus 240 to continue fetching 
data. The problem is that the one to two microsecond initial delay occurs all 
over again. 

20 For example, if a cache line is 32 DWords, the PCI to PCI bridge 250 

prefetch size is 8 DWords, and the SCSI disk controller 210 is attempting 64 
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DWorcl bursts. The host bridge 230 will support these 64 DWord bursts, but 
the conventional PCI to PCI bridge 250 will not. The PCI to PCI bridge 250 
breaks up each 64 DWord burst into eight, eight DWord bursts. So, while the 
overall transfer could be completed in around one to two microseconds, the 
5 bridge 250, instead, completes the overall transfer in 8 to 1 6 microseconds 
because of the PCI to PCI bridge behavior. This is a serious system 
performance impact. 

How typical PCI to PCI bridges attempt to increase read performance 
10 Most conventional PCI to PCI bridges 250 do not have many built in 

performance enhancing features, with regard to memory read multiple 
commands. With typical PCI to PCI bridge devices, the applicant 
traditionally increased read performance by increasing the depth of the 
PCI to PCI bridge's internal FIFOs and increasing the memory read 
15 prefetch size uniformly for memory read, memory read line, and memory 
read multiple commands. 

This solution is the typical approach, primarily because it is easy to 
implement, but this solution has a serious negative impact to overall system 
20 throughput. By increasing the size of the read prefetch, the instantaneous 
memory read throughput increases. However, the fact that the prefetch size 
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increases for all types of memory read operations (rather than matching the 
type of read operation to the performance needs) has negative ramifications. 
Memory read and memory read line operations are typically used for smaller 
data transfers. So, with these cycles, the PCI to PCI bridge 250 will end up 
5 prefetching large amounts of read data that is never used by the requesting 
PCI Master. 


The wasted read data results in wasted time spent by the PCI to PCI 
bridge 250 on the destination bus (primary PCI bus in the previous 
10 examples). This means that while the PCI to PCI bridge 250 is reading this 
"soon to be unused" data from the primary PCI bus, that bus cannot be used 
by another device that needs it. So, even though the effective memory read 
throughput is boosted, the deleterious affect on the overall system throughput 
results. 


Better Solution: Dynamic Performance Enhancing Variable Prefetch 
The bridge 350 according to the present invention, depicted in Figure 
20 3, provides programmable prefetch sizes for memory read and memory read 
line commands (for example, 8 DWords, or 16 DWords), and an extended 
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prefetch size for memory read multiple commands. The improved PCI-to-PCI 
bridge 350 increases the memory read multiple prefetch size to four times the 
size of a memory read and a memory read line prefetch size. For example, if 
the prefetch size for memory read and memory read line commands is set to 
5 1 6 DWords, then the prefetch size for memory read multiple commands is set 
to 64 DWords. 

According to the present invention, the PCI Master design 
advantageously decides dynamically (or, "on the fly") which prefetch size to 

10 use based on the PCI cycle type. The use of this feature greatly enhances 
the memory read performance of the PCI to PCI bridge 350 making it faster 
than most other PCI to PCI bridge devices 250 on the market. It raises the 
overall system performance dramatically. Note that the solution sets the 
prefetch size of memory read multiple cycles to four times the size of the 

15 other types of memory read commands. This approach can be implemented 
by using other multiples or with a programmable multiple, or the standard PCI 
specification cache line size register can be adjusted such that the PCI to 
PCI bridge 350 actually prefetches multiple cache lines. 
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Though the invention has been described with respect to a specific 
preferred embodiment, many variations and modifications will become 
apparent to those skilled in the art upon reading the present application. It is 
therefore the intention that the appended claims be interpreted as broadly as 
possible in view of the prior art to include all such variations and 
modifications. 
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